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Abstract 

In this paper, we provide a novel matrix- analytic approach for studying doubly ex- 
ponential solutions of randomized load balancing models (also known as supermarket 
models) with Markovian arrival processes (MAPs) and phase-type (PH) service times. 
We describe the supermarket model as a system of differential vector equations by 
means of density dependent jump Markov processes, and obtain a closed-form solu- 
tion with a doubly exponential structure to the fixed point of the system of differential 
vector equations. Based on this, we show that the fixed point can be decomposed into 
the product of two factors inflecting arrival information and service information, and 
further find that the doubly exponential solution to the fixed point is not always 
unique for more general supermarket models. Furthermore, we analyze the exponen- 
tial convergence of the current location of the supermarket model to its fixed point, 
and apply the Kurtz Theorem to study density dependent jump Markov process given 
in the supermarket model with MAPs and PH service times, which leads to the Lip- 
schitz condition under which the fraction measure of the supermarket model weakly 
converges the system of differential vector equations. This paper gains a new under- 
standing of how workload probing can help in load balancing jobs with non-Poisson 
arrivals and non-exponential service times. 
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1 Introduction 

Randomized load balancing, where a job is assigned to a server from a small subset of 
randomly chosen servers, is very simple to implement, and can surprisingly deliver better 
performance (for example reducing collisions, waiting times, backlogs) in a number of ap- 
plications, such as data centers, hash tables, distributed memory machines, path selection 
in networks, and task assignment at web servers. One useful model extensively used to 
study randomized load balancing schemes is the supermarket model. In the supermarket 
model, a key result by Vvedenskaya, Dobrushin and Karpelevich [42J indicated that when 
each Poisson arriving job is assigned to the shortest one of d > 2 randomly chosen queues 
with exponential service times, the equilibrium queue length can decay doubly exponen- 
tially in the limit as the population size n — > oo, and the stationary fraction of queues 

d k -i 

with at least k customers is p d - x , which indicates a substantially exponential improve- 
ment over the case for d = 1, where the tail of stationary queue length in the corresponding 
M/M/l queue is p k . At the same time, the exponential improvement is also illustrated 
by another key work in which Luczak and McDiarmid [21] studied the maximum queue 
length in the supermarket model with Poisson arrivals and exponential service times. 

The distributed load balancing strategies in which individual job decisions are based 
on information on a limited number of other processors, have been studied by analytical 
methods in Eager, Lazokwska and Zahorjan (9J \10\ [TTj and by trace-driven simulations 
in Zhou [47J. Based on this, the supermarket models can be developed by using either 
queueing theory or Markov processes. Most of recent research deals with a simple su- 
permarket model with Poisson arrivals and exponential service times by means of density 
dependent jump Markov processes. The methods used in the recent literature are based 
on determining the behavior of the supermarket model as its population size grows to 
infinity, and its behavior is naturally described as a system of differential equations whose 
fixed point leads to a closed-form solution with a doubly exponential structure. Readers 
may refer to, such as, Azar, Broder, Karlin and Upfal [3j, Vvedenskaya, Dobrushin and 
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Karpelevich [32] and Mitzenmacher [26], [27], 

Certain generalizations of the supermarket models have been explored, for example, in 
studying simple variations by Mitzenmacher and Vocking [M] , Mitzenmacher [28} [29] [32] , 
Vocking [41j, Mitzenmacher, Richa, and Sitaraman [33] and Vvedenskaya and Suhov [43J; 
in discussing load information by Mirchandaney, Towsley, and Stankovic [35], Dahlin [7J 
and Mitzenmacher |31[ [33] ; and in mathematical analysis by Graham |12[ [TB"] [14j , Luczak 
and Norris [23] and Luczak and McDiarmid |2H 122]. Using fast Jackson networks, Martin 
and Suhov [25], Martin [23], Suhov and Vvedenskaya [ID] studied supermarket mall models, 
where each node in a Jackson network is replaced by N parallel servers, and a job joins 
the shortest of d randomly chosen queues at the node to which it is directed. For non- 
Poisson arrivals or for non-exponential service times, Li, Lui and Wang [19] discussed the 
supermarket model with Poisson arrivals and PH service times, and indicated that the 
fixed point decreases doubly exponentially, where the stationary phase-type environment 
is shown to be a crucial factor. Bramson, Lu and Prabhakar [4j provided a modularized 
program based on ansatz for treating the supermarket model with Poisson arrivals and 
general service times, and Li [18] further discussed this supermarket model by means of 
a system of integral-differential equations, and illustrated that the fixed point decreases 
doubly exponentially and that the heavy-tailed service times do not change the doubly 
exponential solution to the fixed point. 

For the PH distribution, readers may refer to Neuts [361 [37] and Li [17] . The MAP 
is a useful mathematical model, for example, for describing bursty traffic, self similarity 
and long-range dependence in modern computer networks, e.g., see Adler, Feldman and 
Taqqu pQ. For detail information of the MAP, readers may refer to Chapter 5 in Neuts 
[37] . Lucantoni [20] . Chapter 1 in Li [T7J, and three excellent overviews by Neuts [39J, 
Chakravarthy [5] and Cordeiro and Kharoufeh [6]. In computer networks, Andersen and 
Nielsen [2] applied the MAP to describe long-range dependence, and Yoshihara, Kasahara 
and Takahashi [46] analyzed self-similar traffic by means of a Markov-modulated Poisson 
process. 

It is interesting to answer whether or how non-Poisson arrivals or non-exponential 
service times can disrupt doubly exponential solutions to the fixed points in supermarket 
models. To that end, this paper studies a supermarket model with MAPs and PH service 
times, and shows that there still exists a doubly exponential solution to the fixed point. 
The main contributions of the paper are threefold. The first one is to provide a novel 
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matrix-analytic approach to study the supermarket model with MAPs and PH service 
times. Based on density dependent jump Markov processes, the supermarket model is 
described as a system of differential vector equations whose fixed point has a closed- 
form solution with a doubly exponential structure. The second one is to obtain a crucial 
result that the fixed point can be decomposed into the product of two factors inflecting 
arrival information and service information, which indicates that the doubly exponential 
solution to the fixed point can exist extensively, but it is not always unique for more 
general supermarket models. The third one is to analyze exponential convergence of 
the current location of the supermarket model to its fixed point. Not only does the 
exponential convergence indicate the existence of the fixed point, but it also shows that 
such a convergent process is very fast. To study the limit behavior of the supermarket 
model as its population size goes to infinity, this paper applies the Kurtz Theorem to study 
density dependent jump Markov process given in the supermarket model with MAPs and 
PH service times, which leads to the Lipschitz condition under which the fraction measure 
of the supermarket model weakly converges the system of differential vector equations. 

The remainder of this paper is organized as follows. In Section 2, we first describe 
a supermarket model with MAPs and PH service times. Then the supermarket model 
is described as a systems of differential vector equations in terms of density dependent 
jump Markov processes. In Section 3, we first introduce a fixed point of the system of 
differential vector equations, and set up a system of nonlinear equations satisfied by the 
fixed point. Then we provide a closed-form solution with a doubly exponential structure to 
the fixed point, and show that the fixed point can be decomposed into the product of two 
factors inflecting arrival information and service information. In Section 4, we provide an 
important observation in which the doubly exponential solution to the fixed point is not 
always unique for more general supermarket models. In Section 5, we study exponential 
convergence of the current location of the supermarket model to its fixed point. In Section 
6, we apply the Kurtz Theorem to study density dependent jump Markov process given 
in the supermarket model with MAPs and PH service times, which leads to the Lipschitz 
condition under which the fraction measure of the supermarket model weakly converges 
the system of differential vector equations. Some concluding remarks are given in Section 
7. 
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2 Supermarket Model Description 



In this section, we first provide a supermarket model with MAPs and PH service times. 
Then the supermarket model is described as a system of differential vector equations based 
on density dependent jump Markov processes. 

We first introduce some notation as follows. Let A B be the Kronecker product of 
two matrices A = {a^j) and B = (bij), that is, A B = (ciijB); A® B the Kronecker 
sum of A and B, that is, A® B = A® I + I ® B. We denote by A B the Hadamard 
Product of A and B as follows: 



Now, we describe the supermarket model, which is abstracted as a multi-server multi- 
queue queueing system. Customers arrive at a queueing system of n > 1 servers as a 
MAP with an irreducible matrix descriptor (nC, nD) of size tua- Let 7 be the stationary 
probability vector of the irreducible Markov chain C + D. Then the stationary arrival rate 
of the MAP is given by nX = n^fDe, where e is a column vector of ones with a suitable 
size. The service time of each customer is of phase type with an irreducible representation 
(ct,T) of order mg, where the row vector a is a probability vector whose jth entry is the 
probability that a service begins in phase j for 1 < j < mg; T is an mg x mg matrix 
whose (i,j) th entry is denoted by Uj with t^i < for 1 < i < tub, and tij > for 
1 < i,j < m B and i 7^ j. Let T° = —Te ^ 0. When a PH service time is in phase i, 
the transition rate from phase i to phase j is Uj, the service completion rate is tf, and 
the output rate from phase i is /Xj = —t^. At the same time, the expected service time is 
given by = — aT~ 1 e. Each arriving customer chooses d > 1 servers independently and 
uniformly at random from the n servers, and waits for service at the server which currently 
contains the fewest number of customers. If there is a tie, servers with the fewest number 
of customers will be chosen randomly. All customers in every server will be served in the 



A®B = (aijbij) . 



Specifically, for k > 2, we have 



A ek = A A ■ ■ ■ A. 
•• .. ' 



k matrix A 



For a vector a = (cti, 0,2, ■ ■ ■ , a m ), we write 
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first-come-first service (FCFS) manner. We assume that all the random variables defined 
above are independent, and that this system is operating in the region p = X/p < 1. 
Please see Figure 1 for an illustration of such a supermarket model. 



Markovian Arrival Process 
(C, D) y< f 

each customer 
probes d servers 



._V-- ' 



2 _ 



--id 
/ 



J ---- d-1 



Figure 1: The supermarket model wherein each customer can probe d servers 



The following lemma, which is stated without proof, provides an intuitively sufficient 
condition under which the supermarket model is stable. Note that this proof can be given 
by a simple comparison argument with the queueing system in which each customer queues 
at a random server (i.e., where d = 1). When d = 1, each server acts like a MAP/PH/1 
queue which is stable ifp = A//i<l, see chapter 5 in Neuts [37] . The comparison argument 
is similar to those in Winston |45] and Weber [44] . thus we can obtain two useful results: 
(1) the shortest queue is optimal due to the assumptions on MAPs and PH service times; 
and (2) the size of the longest queue in the supermarket model is stochastically dominated 
by the size of the longest queue in a set of n independent MAP/PH/1 queues. 



Lemma 1 The supermarket model with MAPs and PH service times is stable if p = 
X/p < 1. 

We define n£ (t) as the number of queues with at least k customers who include the 



customer in service, the MAP in phase i and the PH service time in phase j at time t > 0. 



Clearly, < nt (f) < n for 1 < i < mA, 1 < j < m-B an d k > 0. Let 



and for k > 1 



4° (M) 



nf (t) 



n 



4 j) a) 



n 



6 



which is the fraction of queues with at least k customers, the MAP in phase i and the PH 
service time in phase j at time t > 0. Using the lexicographic order we write 

X n (0, t) = (x« (0, t) , (0, t) , . . . , 4"^) (0, t)) 

and for k > 1 

A^ (fe, i) =(4 ■ ^ (fc, t) ,x n ' ^ (k, t) , . . . ,x n ' B ^ (k, t) ; . . . ; 

(A;, t) , 4 m ^- 2 ) (k,t) , xt A ' ms) (k, t)), 

X n (t) = (X n (0,t),X n (l,t),X n (2,t),...). 

The state of the supermarket model may be described by the vector X n (t) for t > 0. 
Since the arrival process to the queueing system is a MAP and the service time of each 
customer is of phase type, the stochastic process {X n (t) ,t > 0} describing the state of 
the supermarket model is a Markov process whose state space is given by 



^ _/f o (0) „(1) „(2) 



■ g^ is a probability vector, g£ :) > > 
for k > 2, and ng„ is a vector of nonnegative integers for I > 0}. 



Let 



and > 1 



4 i} (n,t) = £[4° (n,t) 



4* J ' ) (n,t) = ^[xP(n,t)" . 
Using the lexicographic order we write 

S (n, t) = (4 1} (n, i) , 4 2) (n, i) , . . . , s { mA) (n, t)) 



and for fc > 1 



5 fc (n, i) =(4 1 ' 1) (n, t) , (n, t) , . . . , (n, i) ; . . . 



,(1.2) 



(l,m s ) 



,K,i) 



(n,t), S ^' 2) (n,t),..., S p"' W («^))> 
5 (n, i) = (5 (n, t) , Si (n, i) , S 2 (n, t) , . . .) . 

As shown in Martin and Suhov [25] and Luczak and McDiarmid [21J, the Markov process 
{X n (t) ,t > 0} is asymptotically deterministic as n — > oo. Thus the limits lim^^co E Xq (n, t) 
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and lim^oo E 
this, we write 

for k > 1 

and 



„(iJ) 



n, t) always exist by means of the law of large numbers. Based on 



S (t) = lim S (n, t) , 

n—too 



S k (t) = lim S k (n, t) , 

n-5>oo 



S(t) = (S (t),S 1 (t),S 2 (t),...). 

Note that Sq (t) and S k (t) are two row vectors of order tua and m^m^, respectively. Let 
X (t) = lim^oo X n (t). Then it is easy to see from the MAPs and the PH service times 
that {X (t) ,t > 0} is also a Markov process whose state space is given by 

n = { (s (0) ,s (1) ,5 (2) , • • •) : 5 (0) is a probability vector,^" 1 ) > > o} . 

If the initial distribution of the Markov process {X n (t) ,t> 0} approaches the Dirac 
delta-measure concentrated at a point g £ Q, then the limit X (t) = linij^oo X n (t) 
is concentrated on the trajectory S g = {S (t) : t > 0}. This indicates a law of large 
numbers for the time evolution of the fraction of queues of different lengths. Further- 
more, the Markov process {X n (t) ,t > 0} converges weakly to the fraction vector S (t) = 
(Sq (t) , Si (t) , S2 {t) , . . .) as n — > 00, or for a sufficiently small e > 0, 

lim P{\\X n (t)-S(t)\\ >e} = 0, 

where ||a|| is the Loo-norm of vector a. 

The following proposition shows that the sequence {Sk (t) ,k > 0} is monotone de- 
creasing, while its proof is easy by means of the definition of S (t). 

Proposition 1 For 1 < k < I 

Si(t)<S k (t) 

and 

S t (t) e<S k {t)e< S (t) e = 1. 

In what follows we set up a system of differential vector equations satisfied by the 
fraction vector S (t) by means of density dependent jump Markov processes. 

We first provide an example to indicate how to derive the differential vector equations. 
Consider the supermarket model with n servers, and determine the expected change in 
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the number of queues with at least k customers over a small time period of length dt. The 
probability vector that an arriving customer joins a queue of size k — 1 during this time 
period is given by 



S^i (n, t) (D®I) + Sf d (n, t) (C ® J) 



• ndt, 



since each arriving customer chooses d > 1 servers independently and uniformly at random 
from the n servers, and waits for service at the server which currently contains the fewest 
number of customers. Similarly, the probability vector that a customer leaves a server 
queued by k customers during this time period is given by 

(n, t) (J ® T) + S k+1 (n, t) (I ® T°a)] ■ ndt. 

Therefore, we can obtain 



dE [n k (n, t)] = (n, t) (D ® I) + S Qd (n, t) (C ® I) 



ndt 



which leads to 



+ [S h (n, t) (/ ® T) + n5 fc+ i (n, *) (/ ® T°a)] ■ ndt, 



d5fc(M) =Sf^ (n, t) (D®I) + Sf (n, t) (C ® /) 



df 



+ S fc (n, t) (I ® T) + 5 fe+1 (n, i) (/ ® T°a) 



(1) 



Using a similar analysis for Equation ([I]), we can obtain a system of differential vector 
equations for the fraction vector S (n, t) = (So (n, t) , Si (n, t) , S2 (n, t) , . . .) as follows: 



dt 



So (n,t) e = 1, 
So (n, t) = S o 0d (n, t) C + Si (n, t) (I ® T°) 



(2) 
(3) 



and for k > 2 



dt 



Si (n, t) =S Wd (n, t) (D ® a) + Sf d (n, t) (C ® I) 
+ Si (n, t) (J ® T) + S 2 (n, t) (i ® T°a) 



dS fc (n,t) 
dt 



S®^ (n, t) (D ® J) + Sjf a (n, t) (C ® J) 
+ S fc (n, t) (J ® T) + S fe+ i (n, t) (i ® T°a) 



(4) 



(5) 
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Noting that the limit lim n _ 5 . 00 Sk (n, t) exists for k > and taking n — > oo in the both 
sides of the system of differential vector equations (|2|) to ([5]), we can easily obtain a system 
of differential vector equations for the fraction vector S (t) = (So (t) , S± (t) , S2 (t) , . . .) as 
follows: 

S (t)e = l, (6) 
±S (t) = S° d (t) C + S 1 (t) (I T°) , (7) 

A Si (t) =S o 0d (t) (D ® a) + Sf d (i) (C ® J) 

+ Si (t) (J ® T) + S 2 (t) (I ® T°a) , (8) 



and for k > 2, 



dt 



=S£* (t) (Z» ® J) + 5® d (t) (C I) 
+ 5 fc (t) (/ ® T) + S fc+ i (t) (/ ® T°a) . (9) 



Remark 1 (a) For the supermarket model, many papers, such as Mitzenmacher [26] and 
Luczak and McDiarmid [21], assumed that the arrival process is Poisson with rate nX. As 
a direct generalization of the Poisson arrivals with rate nX, this paper uses a MAP with an 
irreducible matrix descriptor (nC, nD) of size whose stationary arrival rate is given 
by nX = n^De. 

(b) When there are n servers in the supermarket model, we may use a more general 
MAP with an irreducible matrix descriptor (C n ,D n ) of size tua, where 

lim — - = C, lim — — = D, 

n— >oo n n— »oo fl 

and (C, D) is also the irreducible matrix descriptor of a MAP. It is easy to see from the 
above analysis that we can also obtain the system of differential vector equations to 
(PJ) with respect to the more general MAP. 



3 Doubly Exponential Solution 

In this section, we provide a novel matrix-analytic approach for computing the fixed point 
of the system of differential vector equations © to ©, and give a closed- form solution 
with a doubly exponential structure to the fixed point. 
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A row vector tt = (ttq, tt\, 7T2, . . .) is called a fixed point of the fraction vector S (t) if 
lim^+oo S (t) = tt. In this case, it is easy to see that 



lim 

t— >+oo 



0. 



Therefore, as t — > +00 the system of differential vector equations ([6]) to ([9]) can be simpli- 
fied system of nonlinear equations as follows: 



7r e = 1, 

7T® d C + +7T 1 (I ® T°) = 0, 

vr® d (D ® a) + vrf d (C (8) /) + tti (J ® T) + vr 2 (/ ® T°a) = 0, 



(10) 

(11) 
(12) 



and for k > 2, 



7T®f j (D ® J) + 7T® d (C ® J) + 7T fc (J ® T) + (/ ® T°o) 



0. (13) 

It is very challenging to solve the system of nonlinear equations (|10p to (|13p . Here, our 
goal is to derive a closed-form solution with a doubly exponential structure to the fixed 
point tt = (ttq, 7Ti, 7T2, ...) through a novel matrix-analytic approach. 

It follows from Equations (|12h and (I13D that 

/ C®I D ®I \ 
C®I D ®I 

C®I £)®7 



r 0rf ^0rf ^©d 



+ (7ri,7T2,7r3, 



V 

i®r 

7 ® T°a I ® T 

I ® T°a I ® T 



/ 



(vr o 0d (£®a),0,0,...) . 



(14) 



Let 



A 



I I®T 

I®T°a J®T 

J ® T°a I ® T 

V 
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Then it is easy to check that the matrix A is invertible, and 





( 


I 


8> (- 














I 


8> 


ea 






S> (- 








I 


8> 


ea 




i® 


ea 


{-T)-\ 


I^(-T)- 1 




I 


8> 


ea 


:-t)- { 




ea 




i^leai-ry 1 ] /®( 



V : 

C®I D®I 

C®I D®I 

C®I D®I 



\ i 



■ J 



R V 
W R V 
W W R V 



V : 



and 



where 



7r® d (L>®a),0,0,... {-A 



l —IN _ f^Qd 



Tr$ a D<g) [a(-T)- 1 ] ,0,0,...) 



V = D®(-T)-\ 
W = (C + D)® \ea(-T)- 1 



and 



R = C (-T) + D ea(-T)' 
Thus it follows from (|14p that 

( R V 
W R V 



K,vr 2 ,7r3,...)=(^,<,7r 3 0d ,...) 



\ 



W W R V 



V : 



- K ^ 



q(-T)- 1 ] ,0,0,...) 



which leads to a new system of nonlinear equations as follows: 

7T! = Tl® d D <g> a I 

and for k > 2, 



i=2 



j=fc+l 



12 



m 



Now, we need to omit the two terms 7r® R for I > 1 and ^jzLfc 77 ^ W f° r k > 2 
Equations (|16p and f)17|) . Note that the Markov chain C + D is positive recurrent, we 
assume that the system of nonlinear equations (fT6j) and ([T7J) has a closed-form solution 



7T = 6*7° d 



(18) 
(19) 



and for k > 1 

7Tfc = r (/c) ^7 ^ (8) a°3^ , 

where 6 = rfe, and r (A;) is a positive constant for fc > 1. Then it follows from (j!6p . 
(fT7j) and (HU) that 



r (1) (V 3 ^ ® a s) =7r 0d D [a (-T)" 1 + r d (1) (7 ® a) 



R 



3=2 



and for k > 2, 



r (Ar) (j ^ ® a ^ =r d (A; - 1) (7 ® a) V + r d (k) (7 ® a) i? 



Note that 



and 



it is clear that 



j=k+i 



(7® a) W = (7® a) {(C + D) ® ea(-T)" 1 } 
= 7 (C + D) ® a [ea (-T)" 11 

7 (C + J D) = 0, 
(7 ® a) = 0. 



Similarly, we can compute 

(7 ® a) i? = (7 ® a) jc ® (-T)" 1 + D - 
= 7 (C + j D)®q(-T)" 1 = 0. 

It follows from flU and fl2I]) that 

7TL = vr ^ ® \a (-T)- 1 



en 



(-T)- 1 } } 



(20) 



(21) 



(22) 
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or 



r (1) (7 d <g> a°d 



and for k > 2 



VTfc = 7T fc _ 1 



a(-T) 

T yl 



-1 



or 



r (k) (j ^ ® a ^) = r d (k - 1) (7 <g> a) (d ® (-T) -1 ) 



(23) 
(24) 
(25) 



Let cj = l/a de. Then < < 1 due to 7 de > 1 and a & de > 1. Note that 
7Tq = #7°^, A = 7-De, 1/p = a (— T) _1 e and /? = A//i, it follows from ([23]) and ([25]) that 



r(D 



(26) 



and for k > 2 



r (k) = r d (k- 1) tfwp 



[r^f- 1 (eupf- 2+dk - 3+ - +1 

9 dk (6upf~ 1+dk ~ 2+ - +1 



It is easy to see from ([Tg]) . ([15 ]) and (|2T]1 that 



to 



7 ®3 



and for k > 1 



.,0 



ir k = 9 d (dup) d -i ■^d®a CJ d. 
Now, we use ([28]) and ([29]) to check Equations (HH and ([22]) that 

7T 0d C + 7Q (I ® T°) = 0, 



(27) 



(28) 



(29) 



7T! = 7T® d £> 



a(-T) 



-1 



which leads to 

vr 0d (C + D) = 0. (30) 

Obviously, ttq = 6 ■ 7 d is a non-zero nonnegative solution to Equation (|30p. and 7Toe = 1. 

Summarizing the above analysis, the following theorem describes a closed- form solution 
with a doubly exponential structure to the fixed point. 
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Theorem 1 The fixed point it = (ttq, 7Ti,7T2, . . .) is given by 



•7 



and for k > 1 , 



d 1 ml ml 
• 7 w d (g) a w <i . 



The following corollary indicates that the fixed point can be decomposed into the 
product of two factors inflecting arrival information and service information. Based on 
this, it is easy to see the role played by the arrival and service processes in the fixed point. 

Corollary 2 The fixed point ir = (ttq, tti, 7T2, • • •) can be decomposed into the product of 
two factors inflecting arrival information and service information 

d k -i 

f d k+1 -i d k -i i ") I / oj\ 



-1 \ d-1 . d 



a & ~d > , k > 0. 



Remark 2 VFe consider a supermarket model with Poisson arrivals with rate A and ex- 
ponential service times with rate p, which has been extensively analyzed in the literature. 
Obviously, ttq = 1. It follows from that 



( 



^&d ^Qd ffld 
^1 ,K 2 ,7T 3 > 



-A A 



\ 



-A A 



+ (7Tl,7r2,7r 3 , . . .) 



V 

-A* 



-A A 



(A, 0,0,...), 



which leads to 



(7Ti,7T2,7r3, 



Thus we obtain 



r &d ^Qd _Qd 



,...) 



/ p 

p 
p 

\ 



+ (p,0,0,...)- 
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and for k > 2, 

which is the same as Lemma 3.2 in Mitzenmacher \21^ . 

Based on Theorem [IJ we now compute the expected sojourn time T d that a tagged 
arriving customer spends in the supermarket model. For the PH service time X with an 
irreducible representation (q,T), the residual time Xr of X is also of phase type with 
an irreducible representation (r, T), where r is the stationary probability vector of the 
Markov chain T + T°a. Thus, we have 

E[X] =a(-T)- 1 e = -, E [Xr] = r (— T) -1 e. 

P 

For the PH service times, a tagged arriving customer is the kth. customer in the cor- 
responding queue with probability ^\e — 7T® e. Thus it is easy to see that the expected 
sojourn time of the tagged arriving customer is given by 

oo 

E [T d ] = (n° d e - vrf d e) E[X] + Y, (^e - rr^e) [E [X R ] + kE [X]} 

k=l 

oo 

= {E [X R ] -E[X]} nf d e + E[X]J2 ^ 

1 00 fc+i 

= 6 d2 {9uj P ) d (r - a) (-T)- 1 e + - ^ 9 dk+1 (Oujp)^^ . 

When the arrival process and the service time distribution are Poisson and exponential, 
respectively, it is clear that a = r = 1 and 9 = lo = 1, thus we have 

1 ~ d fc+i-d 
E[T d ) = -Y,P~^, 
" fe=o 

which is the same as Corollary 3.8 in Mitzenmacher |27j . 

In what follows we provide an example to indicate how the expected sojourn time 
-E[TJ depends on the choice number d. We assume that m = 2 and 





( -10 7 1 






H 










l 4 -9 1 




l 3 2 j 



and the service times are exponential with service rate p, = 5, 10, 20, respectively. It is 
seen from Figure 2 that the expected sojourn time i£[Ty decreases very fast as the choice 
number d increases. 
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d 

Figure 2: E[T d ] vs d for the MAP 

4 An Important Observation 

In this section, we analyze a special supermarket model with Poisson arrivals an PH service 
times, and obtain two different doubly exponential solutions to the fixed point. Based on 
this, we give an important observation, namely that the doubly exponential solution to 
the fixed point is not always unique for more general supermarket models. 
When the arrival process is Poisson, it follows from (|10p to (|13p that 

vr = 1, (31) 

- A + 7TiT° = 0, (32) 

Xa - \irf d + tt\T + ir 2 T°a = 0, (33) 

and for k > 2, 

Att®^ (t) - Xirf (t) + n k (t) T + n k+1 (t) T°a = 0. (34) 

For the system of nonlinear equations (131 1) to (I34p , we can provide two different doubly 
exponential solutions to the fixed point ir = (ttq,tti,tt2, ■ ■ ■)■ 
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4.1 The first doubly exponential solution 



The first doubly exponential solution has been given in Section 3. Here, we simply list 
the crucial derivations for the special supermarket model. 
It follows from ([HI) that 



/ 



r 0d ^Qd „®d 



(Aa } 0,0,...), 



which leads to 



-A A 



\ 



-A A 



-A A 



+ (7ri,7r 2 ,7r3, . . .) 



/ T 

T°a T 

T°a T 

V 



(7ri,7T2, 7T 3j 



&d Qd Od 
7T 1 , 7T 2 , 7T 3 , . . . 



+ (Aa(-T) -1 ,0,0 



( R V 

R V 
R V 

\ 



\ 



■ J 



where 



and 



Thus we obtain 



and for k > 2 



V = \(-T)- 1 
R = A(-I + ea)(-T) _1 . 
TTi = Aa (-T)- 1 + vrf d \\ {-I + ea) (-T)" 1 



A (-T)- 1 ] + irf \\ {-I + ea) (-T) -1 



(35) 



(36) 



To omit the term 7ri? 
the following expression 



A (— I + ea) (— T) 1 for A; > 1, we assume that {TTk,k > 1} has 
7Tfc = r (k) a®rf. 



In this case, we have 



7T 



0ti 



A {-I + ea) (-T)" 1 ! = r d (k) a \\ (-/ + ea) (-T)" 1 
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thus it follows from (1351) and (1361) that 



7Ti = Aa (— T) 1 



(37) 



and for k > 2 



It follows from (1371) that 



which follows that 



It follows from (1381) that 



A(-T)- 1 



r(l)a©a = Xa(-T)- 1 , 



r (1) = bjp. 



(38) 



r(A:)a s = r d (jfe - 1) a A (— T) 



v-1 



which follows that 



Therefore, we can obtain 



and for A; > 1 



r (£;) = r (k - 1) = (wp) d - 



7T = 1 



d -1 „ J_ 

7Tfc = (up) • a 3. 



(39) 



4.2 The second doubly exponential solution 

The second doubly exponential solution was given in Li, Lui and Wang [19] . thus we 
provide some crucial computational steps. 
It follows from (1321) that 



vnT = A. 



(40) 



To solve Equation (|4T)j) , we denote by r the stationary probability vector of the irreducible 
Markov chain T + T°a. Obviously, we have 

tT° = fx, 



-rT u = A. 



(41) 
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Thus, we obtain 

A 

71"! = — r = p ■ T. 
Using ttq = 1 and ti\ = p • r, it follows from Equation (f33|) that 

Xa - Xp d -T &d + p-TT + TT 2 T°a = 0, 

which leads to 

A - Xp d ■ r &d e + p-rTe + tt 2 T° = 0. 
Note that rTe = —p and p = X/p, we obtain 

vr 2 r° = Xp d r 0d e. 

Let ip = r Qd e. Then it is easy to see that ip € (0, 1), and 

tt 2 T° = X^p d . 



Using similar analysis on Equation (|40p . we have 

W , d +i 

TT 2 = T = ipp ■ T. 

Based on tt\ = p ■ t and ir 2 = ipp d+1 • r, it follows from Equation (|34p that for k = 2, 
Xp d ■ r Qd - X^ d p d2+d ■ r Qd + iip d+1 ■ tT + 7T 3 T°a = 0, 

which leads to 

Xip P d - X^ d+l p d2+d + ^p d+1 ■ rTe + 7r 3 r° = 0, 



thus we obtain 



Using a similar analysis on Equation (|40p . we have 



n 3 T° = X^ d+1 p d2+d . 



\j,d+l n d 2 +d 
k 3 = P - T = ^+i p d^d + i . T 

d k ~ 1 -i d k -i 

Now, we assume that ir^ = if) d ~ 1 p ■ r is correct for the cases with I = k. Then for 
I = k + 1 we have 

^ 1 pd k ~ 2 +d k - 3 + -+d p d k - l +d k - 2 + -+d . T Qd _ ^d k ~ 1 +d k ~ 2 + -+d p d k +d k - 1 + -+d , T Qd 
+ ^- 2+ ^-3 + ... + l^-l + ^- 2 + ... + l . ^ + 7rfc+lT a = Qj 
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which leads to 

^d k - 2 +d k - 3 +-+d+l p d k - 1 +d k - 2 +-+d _ ^d k - 1 +d k - 2 +-+d+l /3 d k +d k - 1 +-+d 

+ ^-»+d*- 8 +-+i /( ,d*- 1 +d*- a +-+i . rTe + nk+lT o = Qj 
thus we obtain 

By a similar analysis to (|4U|) and (|41|) . we have 



^d fc - 1 +d fc - 2 + ---+d+l /3 d fe +d fc - 1 + ---+(i 
= 1 pd k - 1 +d k - 2 +-+d+l p d k +d k - 1 +-+d+l . r 

Therefore, by induction we can obtain 

7T0 = 1, 

and for k > 1 

rffe" 1 -! d k -l 

7t k = l/) d-l p d-l . t. (42) 

4.3 An important observation 

Now, we have given two expressions (|39p and (|42j) for the fixed point. In what follows we 
provide some examples to indicate that the two expressions may be different from each 
other. 

Example one: When the PH service time is exponential, it is easy to see that 
a = t = 1, which leads to that w = ip = 1. Thus the fixed point is given by 

d k -l 

VTfc = p d " 1 , k > 1. 



In this case, (|39|) is the same as (|42|) . 

Example two: When the service time is an m-order Erlang distribution with an 
irreducible representation (a,T), where 

a = (1,0,. ..,0) 
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and 



We have 



and 



-77 n 



T = 



-7] 7] 



-7] 7] 



-v J 



a & ~ d = (1,0,. ..,0) 



Thus the first doubly exponential solution is given by 



T 



f] 



7T 



(F) 



P — -(1,0,. ..,0), k>l. 



(43) 



It is clear that 



T + T°a 



-7] 7] 



-7] 7] 



-7] 7] 



\ v -v J 

which leads to the stationary probability vector of the Markov chain T + T°a as follows: 



r = 



1 1 



vtl m' ' m 



m 

A mX 

P H 7] 



and 



ip = m — 
m 



m 



1-0 



Thus the second doubly exponential solution is given by 



(SI , d k ~ 1 -i d k -i /ll 1 

7T ( k > =7P d-1 pd-1 

V m m m 



r m~ dk \m- dk \...,m- dk , fc > I. 



(44) 
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It is clear that (|43p and (|44p are different from each other for k,m,d > 2, and 

(F) 

- m . 



(s) 



It is clear that 7r k e ^ ir k e for k,m,d > 2. 

Remark 3 For the supermarket model with Poisson arrivals and PH service times, we 
have obtained two different doubly exponential solutions to the fixed point. It is interesting 
but difficult to be able to find another new doubly exponential solution to the fixed point. 
Furthermore, we believe that it is an open problem how to give all doubly exponential 
solutions to the fixed point for more general supermarket models. 



5 Exponential Convergence 

In this section, we provide an upper bound for the current location S (t) of the supermarket 
model, and study exponential convergence of the current location S (t) to its fixed point 

7T. 

For the supermarket model, the initial point S (0) can affect the current location S (t) 
for each t > 0, since the arrival and service processes are under a unified structure through 
a sample path comparison. To explain this, it is necessary to provide some notation for 
comparison of two vectors. Let a = (01,02,03, . . .) and b = 62, 63, . . .)• We write a -< b 
if Ok < bk for some k > 1 and ai < b\ for I 7^ k, I > 1; and a ^ b if < bk for all k > 1. 

Now, we can easily obtain the following useful proposition, while the proof is clear by 
means of a sample path analysis, and thus is omitted here. 

Proposition 2 // S (0) H S (0), then S (t) ^ S (t) for t > 0. 

Based on Proposition [21 the following theorem shows that the fixed point tt is an upper 
bound of the current location S (t) for all t > 0. 

Theorem 3 For the supermarket model, if there exists some k such that (0) = 0, then 
the sequence {Sk(t)} for all t > has an upper bound sequence {vr^} which decreases 
doubly exponentially, that is, S (i) -<ir for all t > 0. 

Proof: Let 

S k (0)=7T k , k>0. 
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Then for each k > 0, 5& (t) = Sk (0) = irk for all t > 0, since 

5(0) = (5 (0),5i(0),5 2 (0),...) =vr 

is a fixed point for the supermarket model. If Sk (0) = for some k, then 5^ (0) -< 5fc (0). 
Again, if Sj (0) ^ Sj (0) for all j ^ k, then 5 (0) ■< S (0). It is easy to see from Proposition 
[2] that Sk (t) ^ Sk (t) = TTk for all k > and t > 0. Thus we obtain that for all > and 
t > 

Since < 9,w,p < 1, {vrfc} decreases doubly exponentially. This completes the proof. ■ 
To show exponential convergence, we define a Lyapunov function $ (t) as 

oo 

<S>(t) = Y J Wk{TTk-S k (t))e, (45) 

k=0 

where {wk} is a positive scalar sequence with Wk > ^fc-i > = 1 f° r k > 2. 

The following theorem measures the distance of the current location S (t) to the fixed 
point 7r for t > 0, and illustrates that this distance will quickly come close to zero with 
exponential convergence. Hence, it shows that from any suitable starting point, the super- 
market model can be quickly close to the fixed point, that is, there always exists a fixed 
point in the supermarket model. 

Theorem 4 For t > 0, 

*(*) <c e- 5t , 

where cq and 5 are two positive constants. In this case, the Lyapunov function $ (t) is 
exponentially convergent. 

Proof: It is seen from (|45l) that 

k=0 
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It follows from Equations ([6]) to (|9|) that 
d 



dt 



$ (t) = - p o 0d (t) c + 5i (t) (/ ® r°) 

- [5 o 0d (i) (D ® a) + Sf d (i) (C ® I) 
+ Si (t) (I ® T) + & (t) (J ® T°a)]e 

oo 

- £ «; fc [S®i (t) (D ® /) + Sf (t) (C (8 J) 
+ S k (t) (I ® T) + Sfc+i (t) (/ T°a)]e. 

By means of Ce = —-De and Te = — T , we can obtain 
d 



dt 



Let 



for fe > 1 



and 



*(*)=- w [5 o 0d (t) {-De) + S 1 (t) (e ® T°) 

- ^[S^ (t) (De) + Sf (t) ((-De) ® e) 
+ 5i (i) (e ® (-T )) + 5 2 (i) (e ® T )] 

oo 

- £ w ^ S k-i (*) (Pe) ® e) + 5f (*) ((-^e) ® e) 

fe=2 

+ S k (t) (e ® (-T )) + S k+1 (t) (e ® T°)\. 
S° d (t) (De) = c (t) ■ [no - S (t)] e, 



Sf* (t) ((De) ® e) = c fe (t) • [vr fe - 5 fc (t)] . 



(e®T°) =4 (t)-[7r fc -5 fc (t)]e. 

Then it follows from (jl6|) that 
d 



dt 



*(*) = - (wi - wo) c (t) • [vr - So (i)] e 

oo 

- £ [^fc+icfc (t) - w k (c fc (i) + d k (t)) + Wh-idk (*)] • kfc - £fc (i)] 



fc=i 



Let 



^o = 1, 
(wi - tf ) c (t) > 5w 
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and 

Wk+iCk (t) - w k (cfc (i) + dk (t)) + Wk-id k (t) > 5w k . 

Then 

8 

wt > 1 + 



and for k > 2 



co (t)' 
c?i (i) 

™2 > W 1 + 7- + -— (Wl - 1 

Ci (t) Ci (t) 

Sw k d k (t) 

Wk+l >Wk~\ 7-T H 77T [W k - W k -l) ■ 



Thus we have 

d x 

— $ (t) <-5Y,w k [vr fc - S k (t)} e. 

k=0 

It follows from (|45p that 

^* (*)<-»(*), 

which can leads to 

This completes the proof. ■ 

Remark 4 We have provided an algorithm for computing the positive scalar sequence 
{wk} with 1 = wo < Wk-i < u>k for k > 2 as follows: 
Step one: 

w = 1. 

Step two: 

5 

wi = 1 + 



CO (t) 
and 



tfltf! di (t) 
^2 = ^1 + — - + -— [W! - 1 

ci (t) ci (t) 



S'iep i/iree: /or > 2 



(5wfc dfe (t) . 

W fc+ i = H 7-r H 7— (lO* - Wfc_iJ • 

Cfc (*) c fc (t) 

T/iis illustrates that w k is a function of time t for k > 1. iVo£e i/iai A, 5, (£) , d/ (i) > 0, 
it is clear that for k>2 

l = WQ< w k -i < w k . 
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6 A Lipschitz Condition 



In this section, we apply the Kurtz Theorem to study density dependent jump Markov 
process given in the supermarket model with MAPs and PH service times, which leads 
to the Lipschitz condition under which the fraction measure of the supermarket model 
weakly converges the system of differential vector equations. 

The supermarket model can be analyzed by a density dependent jump Markov process, 
where the density dependent jump Markov process is a Markov process with a single 
parameter n which corresponds to the population size. Kurtz's work provides a basis 
for density dependent jump Markov processes in order to relate infinite-size systems of 
differential equations to corresponding finite-size systems of differential equations. Readers 
may refer to Kurtz [16] for more details. 

In the supermarket model, when the population size is n, we write 

Level : E% = {(0, i) : 1 < i < m A } 

and for k > 1 

Level k : = {(k, i, j) : 1 < % < niA, 1 < j < nis} , 

n n 

E n = (J {Level fc} = Q «} ■ 

fc=0 k=0 

In the state space E n , the density dependent jump Markov process for the supermarket 
model with MAPs and PH service times contains four classes of state transitions as follows: 

Class one E% E%: (0,i) (0,i*) or (k,i,j) ->■ (k,i*,j), where 1 < < tua; 

Class two E% E%: (k,i,j) — > (k,i,j*), where 1 < j,j* < mg; 

Class three E% a E% +1 : (0, i) — > or (k,i,j) — > (k + and 

Class four E% E%_ x : ->■ (0,i) or (k,i,j) [k — 

Note that the transitions and express arrival transition and service transition, re- 
spectively. 

We write 




So (n) = (4 1} (») , 4 2) (»),-■■, 4 mA) (»)) ! 
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and for k > 1 



4 H = ( 



A: 



and 

5 fc (n) = ( (n) , 4 1,2) (n) , . . . , ^ W ! - ! 4" W) (*) > 4 mA ' 2) («)>•••> 4""'^ W 



Note that the states of the density dependent jump Markov process can be normalized 
and interpreted as measuring population densities 

S (n) = {So (n) , St (n) ,S 2 (n),...}, 

the transition rates of the Markov process depend only on these densities. 

Let {x„ (t) : t > 0} be a density dependent jump Markov process on the state space 
E n whose transition rates corresponding to the above four cases are given by 

9(fcL)-^(fc,i*j) = = n/W ( s * J) ; 

9(oJ)^(i,ij) = = n A>->i (4° ( n ) 'j) > 

= n/3 fc ^ fc+1 = ^/Wn (4 J) («)) ; 



Let 



Q n) = (/W (4° (*))) 

= (/w ( 

qS = (^- (4 m) n)) 

Q n) (A) = (&_>! (4 } (n),j)) 
Q< B >(A) = (/Wn (4 J) H)) 



'1)1 I 



l<i,i*<m^,l<j<mB 
l<i<mA,l<j,j*<m B 
l<i<m.A,l<j<m.B 
1 <i<myi , 1<j <m,B 
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I<i<m4,l<j'<rrt5 



\ \ / / l<i<m J 4,l<J<»TiB 

In the supermarket model, X n (t) is an unsealed process which records the number of 
servers with at least k customers for < k < n. We write 



Sid) 



Q 



(n) 



( Q [ o ] {A) 



\ 



V 



where 



QW = 7 r [5 (n)] Qd C, 
Q { :l = {l®r) T [S k (n)f d {C®I)- 
Q { sl = in®r) T S k {n) 



(A)=^[S (n)f a (D®a), 

Q<»> (^) = ( 7 ®r) T [5 fc (n)] 0d p0/); 

Qi n) (5) = ( 7 ®T) T ,S 1 (n) (I®T°), 

g(")(5) = ( 7 ®r) T 5 fc (n) (I®T°a). 

Using Chapter 7 in Kurtz [16] or Subsection 3.4.1 in Mitzenmacher |27| . the Markov 
process |x n (t) : t > o| with transition rate matrix = nQ^ is given by 



Qd 



X n (t) = X n (0) + £ Z fe Y b jT* A C^^] ^ , 



(47) 



where Yj, (x) for b £ E are independent standard Poisson processes, Z& is a positive integer 
with Zft < 3ft < +oo, and 

E={(0,i)^(0,i*),(k,i,j) -> (k,i*,j),(k,i,j) -> (fc,i,j*);(0,i) -> (M,j), 

-> + for A; > l;(M,j) (0,i) , (M, j) -> (i - j) for 2 > 2} 



Clearly, the jump Markov process in Equation (j47j) at time t is determined by the starting 
point and the transition rates which are integrated over its history. 
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Let 

F(y) = l ^b(y), (48) 

beE(y) 

where 

E (y) = {b € E : the transition b begins from state y} . 
Taking X n (t) = n~ 1 X n (t) which is an appropriate scaled process, we have 



(49) 



due to the fact that 



X n (t) = X n (0) + V l h n' l % (n f p b (X n (u)) du) + f F (X n («)) du, 

where (y) = Yj, (y) — y is a Poisson process centered at its expectation. 
Let X (t) = lim n ^oo X n (t) and xq = lim n _ s . 0O X n (0), we obtain 

X(t)=x +[ F(X(u))du, t>0, (50) 
J o 

lim -Y b (n [ f3 b (X n (u))du) =0 

by means of the law of large numbers. In the supermarket model, the deterministic and 
continuous process {X (t) ,t > 0} is described by the infinite-size system of differential 
vector equations ([6]) to ©, or simply, 

jX (t) = F (X (t)) (51) 

with the initial condition 

X (0) = x . (52) 

Now, we consider the uniqueness of the limiting deterministic process {X (t) ,t > 0} 
with (15ip and (|52h . or the uniqueness of the solution to the infinite-size system of differ- 
ential vector equations ([6]) to ([9]). To that end, a sufficient condition is Lipschitz, that is, 
for some constant M > 0, 

\F(y) -F(z)\< M\\y- z\\. 

In general, the Lipschitz condition is standard and sufficient for the uniqueness of the 
solution to the finite-size system of differential vector equations; while for the countable 
infinite-size case, readers may refer to Theorem 3.2 in Deimling |8] and Subsection 3.4.1 
in Mitzenmacher |27| for some useful generalization. 
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To check the Lipschitz condition, by means of the law of large numbers we have 



which leads to 



Q 



where 



7Tfc = lim Sk in) , k > 0, 

n— >oo 

( Qo Qo (A) 

Ql(S) Q a ,l+Qs,l Qi(A) 

Q 2 (S) Qa,2 + Qs,2 Q2(A) 

V 

Qo = 7 T vr o 0d C, 
Qa,k = (l®T) T Trf(C®I); 

Qs,k = {l®T) T TT k (J®T); 



Qo (A) = 7 T vr o 0d (D ® 



Q fc (A) = ( 7 ®T) T 7r® d (£)®J); 
Q 1 (5 l ) = ( 7 (»T) T 7r 1 (I®T°), 
Qfc (5) = (7®r) T ^(/®T a) . 



Let 



and for k > 1 



Co 



7r e 



Trjf* QDe g e) 
TT k e 

7T fc (J r°q) 
■K k e 



(53) 



Then CkiVk > f° r & > 1. 

The following theorem shows that the supermarket model with MAPs and PH service 
times satisfies the Lipschitz condition for analyzing the uniqueness of the solution to the 
infinite-size system of differential vector equations © to ([9]) . 

Theorem 5 The supermarket model with MAPs and PH service times satisfies the Lips- 
chitz condition. 
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Proof Let the state space of the Markov process {X (t) ,t > 0} be 

^ = Uk ■ k > 0} . 
For two arbitrary entries y, z G f2, we have 

\F(y)-F(z)\< £ la\Pa(v)-Pa(z)\<& £ \Pa (y) ~ Pa (z) \. 

a€E(y)nE(z) agE(y)nE(z) 

Note that a expresses either an arrival transition or a service transition in the above four 
cases. When a expresses an arrival transition, we can analyze the function (3 a (y) from the 
two cases of arrival transitions; while when b expresses a service transition, the function 
Pb (y) can similarly be dealt with from the two cases of service transitions. 

When a expresses an arrival transition, we analyze the function f3 a (y) based on a € 
E (y) n E (z) from the following two cases. 

Case one: y = ttq, z = tt\. In this case, we have 

\Pa (y) - Pa (z) | = \n° d Ce - 7r o 0d (D ® a) e - irf d (C I) e\ 
= | - ir® d De - ir® d De + irf d (De ® e) | 
= |2Co7roe - Ci7i"ie| 
= |2Co - Ci7Tie|- 

Taking 

M a (0,l)> |2C °- Cl7rie| 



1 — TT\e 
it is clear that 

\p a (y) - p a (z) I < M a (0, 1) (1 - vrie) = M a (0, 1) (ir e - me) . 

Note that ttq and tt\ are two row vectors of sizes tua and m^mB, respectively, in this case 
we write 

\\y — z\\ = TToe — n±e. 

Thus we have 

\p a (y)-Pa(z)\<M a (0,l)\\y-z\\. 



32 



Case two: y = vr^._i, z = ir^ for k > 2. In this case, we have 

\P a (y) - f3 a (z) | =\n^ 2 (D®I)e + tt®^ (C ® J) e 

(*) P®/)e-7rf (C®I)e| 
=kf- 2 (*) e) - tt®^ (L>e ® e) 
- tt^j (£>e ® e) + 7r® d (£>e ® e) | 
= |Cfc-27T/t-2e - 2Cfc-i7r fe _ 1 e + Cfc7Tfce|. 



Let 



Then 



M a (fe-l,fc)> 



I A. (y) " /3a (*) I < M a (k - 1, fe) ||7T fc _i - 7T fc ||. 

Based on the above two cases, taking 

M a = sup{M a (0,l),M o (A:-l,fc) : fc > 2} , 

we obtain that for two arbitrary entries y, z € Q, 

IMy)-M*)|<M ||y-*||. (54) 

Similarly, when b expresses a service transition, we can choose a positive number Mj, 
such that for two arbitrary entries y, z € O, 

IMy)-/36(*)|<M 6 ||y-*||. (55) 

Let M = 5ft max {M a , M^}. Then it follows from (I54p and (155p that for two arbitrary 
entries y,z € f2, 

<M||y-z||. 

This completes the proof. ■ 
Based on Theorem[5l the following theorem easily follows from Theorem 3.13 in Mitzen- 
macher [27]. 

Theorem 6 In the supermarket model with MAPs and PH service times, {X n (t)} and 
{X (t)} are respectively given by |^P| ) and l50j) . we /iaue 

lim sup \X n (u) — X (u) | = 0, a.s. 

n ^°° u<t 
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Proof It has been shown that in the supermarket model with MAPs and PH service 
times, the function F (y) for satisfies the Lipschitz condition. At the same time, it 

is easy to take a subset Q* C SI such that 

{X (u):u<t}c n* 

and 

sup p a (y) + sup P b (y) < +00, 
yen* s/esi* 

a€R(y) b£E(y) 

where a and b express an arrival transition and a service transition, respectively. Thus, 
this proof can easily be completed by means of Theorem 3.13 in Mitzenmacher [27| . This 
completes the proof. ■ 
Using Theorem 3.11 in Mitzenmacher [27] and Theorem [6l the following theorem for 
the expected sojourn time that an arriving tagged customer spends in an initially empty 
supermarket model with MAPs and PH service times over the time interval [0, t]. 

Theorem 7 In the supermarket model with MAPs and PH service times, the expected 
sojourn time that an arriving tagged customer spends in an initially empty system over 
the time interval [0, t] is bounded above by 

1 00 fc+i 
6 d2 {9up) d (r - a) (-T)- 1 e + - ^ 6 dk+1 {0u P )^=^- + o (1) , 

^ k=o 

where o(l) is understood as n — > 00. 

7 Concluding remarks 

In this paper, we provide a novel matrix-analytic approach for studying doubly exponential 
solutions of the supermarket models with MAPs and PH service times. We describe the 
supermarket model as a system of differential vector equations, and obtain a closed-form 
solution with a doubly exponential structure to the fixed point of the system of differential 
vector equations. Based on this, we shows that the fixed point can be decomposed into the 
product of two factors inflecting arrival information and service information, and indicate 
that the doubly exponential solution to the fixed point is not always unique for more 
general supermarket models. Furthermore, we analyze the exponential convergence of 
the current location of the supermarket model to its fixed point, and apply the Kurtz 
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Theorem to study density dependent jump Markov process given in the supermarket 
model with MAPs and PH service times, which leads to the Lipschitz condition under 
which the fraction measure of the supermarket model weakly converges the system of 
differential vector equations. Therefore, we gain a new and crucial understanding of how 
the workload probing can help in load balancing jobs with either non-Poisson arrivals or 
non-exponential service times. 

Our approach given in this paper is useful in the study of load balancing in data 
centers and multi-core servers systems. We expect that this approach will be applicable 
to the study of other randomized load balancing schemes, for example, analyzing a renewal 
arrival process or a general service time distribution, discussing retrial service discipline 
and processor-sharing discipline, and studying supermarket networks. 
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